Instantons in the working memory: implications for schizophrenia. 
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The influence of the synaptic channel properties on the stability of delayed activity maintained 
by recurrent neural network is studied. The duration of excitatory post-synaptic current (EPSC) 
is shown to be essential for the global stability of the delayed response. NMDA receptor chan- 
nel is a much more reliable mediator of the reverberating activity than AMPA receptor, due to a 
longer EPSC. This allows to interpret the deterioration of working memory observed in the NMDA 
channel blockade experiments. The key mechanism leading to the decay of the delayed activity 
originates in the unreliability of the synaptic transmission. The optimum fluctuation of the synap- 
tic conductances leading to the decay is identifled. The decay time is calculated analytically and 
the result is confirmed computationally. 



I. INTRODUCTION 

Long-term memory is thought to be stored in biochem- 
ical modulation of the inter- neuron synaptic connections. 
As each neuron forms about 10^ synapses such a mech- 
anism of memory seems to be very effective, allowing 
potentially the storage of > 10"* bits per neuron. How- 
ever, although the synaptic modifications persist for a 
long time, it may take as long as minutes to form them. 
Since the external environment operates at much shorter 
time scales, the synaptic plasticity is virtually useless for 
the short-term needs of survival. Such needs are satisfied 
by the working memory (WM), which is stored in the 
state of neuronal activity, rather than in modification of 
synaptic conductances (Miyashita, 1988; Miyashita and 
Chang, 1988; Sakai and Miyashita, 1991; Funahashi et 
at, 1989; Goldman-Rakic et al, 1990; Fuster, 1995). 

WM is believed to be formed by recurrent neural cir- 
cuits (Wilson and Cowan, 1972; Amit and Tsodyks, 
1991a, b; Goldman-Rakic, 1995). A recurrent neural net- 
work can have two stable states (attractors), character- 
ized by low and high firing frequencies. External inputs 
produce transitions between these states. After transi- 
tion the network maintain high or low firing frequency 
during the delay period. Such a bipositional "switch" 
can therefore store one bit of information. 

During the last few years it has become clear that 
NMDA receptor is critically involved in the mechanism of 
WM. It is evident from the impairments of the capacity 
to perform the delayed response task produced by the re- 
ceptor blockade (Krystal et al., 1994; Adler et al., 1998, 
Pontecorvo et al., 1991; Cole et al., 1993; Aura et al., 
1999). Similarly the injection of the NMDA receptor an- 
tagonists brings about weakening of the delayed activity 
demonstrated in the electrophysiological studies (Javitt 
et al., 1996, Dudkin et al., 1997a). At the same time 
intracortical perfusion with glutamate receptor agonists 
both improves the performance in the delayed response 
task and increases the duration of WM information stor- 
age (Dudkin et al., 1997a and b). Such evidence is espe- 
cially interesting since administration of NMDA receptor 



antagonists (PCP or ketamine) reproduces many of the 
symptoms of schizophrenia including the deficits in WM. 

Out of many unusual properties of NMDA channel two 
may seem to be essential for the memory storage pur- 
poses: the non-linearity of its current-voltage character- 
istics and high affinity to the neurotransmitter, resulting 
in long lasting excitatory post synaptic current (EPSC). 
The former have been recently implicated in being cru- 
cial for WM (Lisman et al., 1998). It was shown that by 
carefully balancing NMDA, AMPA, and GABA synaptic 
currents one can produce an N-shaped synaptic current- 
voltage characteristic, which complemented by the re- 
current neural circuitry results in the bistability. This 
approach implies therefore that a single neuron can be 
bistable and maintain a stable membrane state corre- 
sponding to high or low firing frequencies (Camperi and 
Wang, 1998). Such a bistability therefore is extremely 
fragile and can be easily destroyed by disturbing the bal- 
ance between NMDA, GABA or AMPA conductances. 
This may occur in the experiments with the NMDA an- 
tagonist. 

The single neuron bistability should be contrasted to 
a more conventional paradigm, in which the bistability 
originates solely from the network feedback. It is based 
on the non-linear relation between the synaptic currents 
entering the neuron and its average firing rate (Amit 
and Tsodyks, 1991a, b; Amit and Brunei, 1997). Such 
a mechanism is not sensitive to the membrane voltage 
and therefore can be realized using e.g. AMPA receptor. 
Thus it may seem that this mechanism is ruled out by 
the NMDA antagonist experiments. 

In this paper we study how the properties of the synap- 
tic receptor can influence the behavior of the conventional 
bistable network. We therefore disregard the phenom- 
ena associated with the non-linearity of synaptic current- 
voltage relation (Lisman et al., 1998). In effect we study 
the deviations from the mean-field picture suggested ear- 
lier (see e. g. Amit and Tsodyks, 1991a, b). The main 
result of this paper concerns the question of stability of 
the high frequency attractor. This state is locally sta- 
ble in the mean-field picture, i. e. small synaptic and 
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other noises cannot kick the system out of the basin of 
attraction surrounding the state. However this state is 
not guaranteed to be globally stable. After a certain pe- 
riod of time a large fluctuation of the synaptic currents 
makes the system reach the edge of the attraction basin 
and the persistent memory state decay into the low fre- 
quency state. We therefore find how long can the working 
memory be maintained, subject to the influence of noises. 

Before the network reaches the edge of attraction basin 
it performs an excursion into the region of parameters 
which is rarely visited in usual circumstances. This jus- 
tifies the use of term "instanton" to name such an excur- 
sion, emphasizing the analogy with the particle traveling 
in the classically forbidden region in quantum mechanics. 
Such analogy have been used before in application to the 
perception of ambiguous signals by Bialck and DcWcese, 
1995. The present study however is based on microscopic 
picture, deriving the decay times from the synaptic prop- 
erties. 

In the most trivial scenario the network can shut it- 
self down by not releasing neurotransmitter in a certain 
fraction of synapses of all neurons. Thus all the neurons 
cross the border of attraction basin simultaneously. This 
mechanism of memory state decay is shown to be inef- 
fective. Instead the network chooses to cross the border 
by small groups of neurons, taking advantage of large 
combinatorial space spanned by such groups. The co- 
operative nature of decay in this problem is analogous 
to some examples of tunneling of macroscopic objects in 
condensed matter physics (Lee and Larkin, 1978; Levitov 
et al, 1995). 

The decay time of the memory state evaluated below 
increases with the size of the network growing (see Sec- 
tion III). This is a natural result since in a large net- 
work the relative strength of noise is small according to 
the central limit theorem. Therefore if one is given the 
minimum time during which the information has to be 
stored, there is the minimum size of the network that can 
perform this task. We calculate therefore the minimum 
number of neurons necessary to store one bit of informa- 
tion in a recurrent network. This number weakly depends 
on the storage time and for the majority of realistic cases 
is equal to 5-15. 

Two complimentary measures of WM stability, the 
memory decay time and the minimum number of neu- 
rons, necessary to store one bit, are shown below to de- 
pend on the synaptic channel properties. The former 
grows exponentially with increasing duration of EPSC, 
which is unusually large for the NMDA channel due to 
high affinity to glutamate. This allows to interpret the 
NMDA channel blocking experiments in the framework 
of conventional network bistability. 

In recent study Wang, 1999 considered a similar prob- 
lem for the network subjected to the influence of external 
noises, disregarding the effects of finiteness of the proba- 



bility of neurotrasmitter release. In our work we analyze 
the effects of synaptic failures on the stability of the per- 
sistent state. We therefore consider the internal sources 
of noise. Our study is therefore complimentary to Wang, 
1999. 

Analytical calculations presented below arc confirmed 
by computer simulations. For the individual neurons we 
use the modified leaky integrate-and-fire model due to 
Stevens and Zador, 1998, which is shown to reproduce 
correctly the timing of spikes in vitro. Such realistic neu- 
rons may have firing frequencies within the range 15-30IIz 
for purely excitatory network in the absence of inhibitory 
inputs (Section II). This solves the high firing frequency 
problem (see e.g. Amit and Tsodyks, 1991a). The reso- 
lution of the problem is based on the unusual property of 
the Stevens and Zador neuron, which in contrast to the 
simple leaky integrator has two time scales. These are the 
membrane time constant and characteristic time during 
which the time-constant changes. The latter, being much 
longer than the former, determines the minimum firing 
frequency in the recurrent network, making it consistent 
to the physiologically observed values (see Section II for 
more detail). 



II. DEFINITION OF THE MODEL AND ITS 
MEAN-FIELD SOLUTION 



In this section we first examine the properties of single 
neuron, define our network model, and, finally solve the 
network approximately, using the mean-field approxima- 
tion. 

The Stevens-Zador (SZ) model of neuron is an exten- 
sion of the standard leaky integrator (see e.g. Tuckwell, 
1998). It is shown to accurately predict the spike timings 
in layer 2/3 cells of rat sensory neocortex. The membrane 
potential V satisfies the leaky integrator equation with 
time-varying resting potential E and integration time r: 



(1) 



Here t is the time elapsed since the last spike generated, 
and the input current I{t) is measured in volts per sec- 
ond. When the membrane voltage reaches the threshold 
voltage 9 the neuron emits a spike and the voltage is reset 
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FIG. 1. The somatic membrane resting potential (a) and the 
integration time (b) as functions of the time elapsed since the 
last spike. 

This model is quite general to describe many types of 
neurons, differing only by the functions E{t), T{t), and 
the parameters 9 and Vreset- For the pyramidal cells in 
cortical layer 2/3 of rats the functions can be fitted by 



and 



E {t) =Eo- AE[1- exp {-at/ro)] 



T (t) = To [1 - exp {-at/To)] . 



(2) 



The parameters of the model for these cells have the fol- 
lowing numerical values: Eq = — 32mV, AE = 28mV, 
a = 0.3, To = 10msec, 6 = — 22mV, and Vreset = — 32mV 
(Stevens and Zador, 1998). The resting potential and 
integration time with these parameters are shown in Fig- 
ure 1. ^ 

In the next step we calculate the transduction func- 
tion / = T[I), relating the average external current to 
the average firing frequency. This function is evaluated in 
Appendix A and is shown in Figure 2. The closed hand 
expression for this function cannot be obtained. Some 
approximate asymptotic expressions can be found how- 
ever. For large frequencies (/ S> a/ro = 30Hz) it is 
approximately given by the linear function (dashed line 
in Figure 2): 
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For small frequencies (/ -C a/ro) we obtain: 



^ Vo In [(l^o - ^1) / (l^^o -e\+AE- to/)] 



(7) 



The neuron therefore starts firing significantly when cur- 
rent exceeds the critical value 



r = 



\Eo -0\+AE 



To 



(8) 



We ignore spontaneous activity in our consideration as- 
suming all firing frequencies below 5Hz to be zero. We 
also disregard the effects related to refractory period 
since they are irrelevant at frequencies 10 — 50Hz. 



(3) ^ 




where 
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FIG. 2. Neuronal transduction function relating the firing 
frequency and the input current (solid line IqAI'B). The 
straight line AB describes the network feedback. The dashed 
line represents the asymptotes of the transduction function 
for large frequencies. It is given by Eq. (4). The expressions 
for Iq and 7* are provided by Eqs. (6) and (8) . The points A 
and B arc the low and high frequency attractors respectively. 
The numbers 123 demonstrate the trajectory of the system 
approaching the high frequency attractor. 



^ Since the time constant is zero sd, t — to resolve the sin- 
gularity an implicit Runge-Kutta scheme should be used in 
numerical integration of (1). 
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Wc consider the network consisting of N SZ neurons, 
establishing all-to-all connections. After each neuron 
emits a spike a EPSC is generated in the input currents of 
all cells with probability k. This is intended to simulate 
the finiteness of probability of the neurotransmitter re- 
lease in synapse. The total input current of n-th neuron 
is therefore 



T{I) = I-\I). 



(13) 



N 



(9) 



where k enumerates the neurons making synapses on the 
n-th neuron (all neurons in the network), ts^ is the time 
of spike number Sk emitted by cell k, and /^^* is the ex- 
ternal current. & is a boolean variable equal to 1 with 
probability k (in our computer simulations always equal 
to 0.3). It is the presence of this variable that distin- 
guishes our approach from Wang, 1999. Wc; chose the 
EPSC represented by j{t) to be (see Amit and Brunei, 
1997) 



j = .7oCxp(-i/TEpsc)-ff(*)> 



(10) 



where H{t) = 1, if t > 0, and H{t) = otherwise. As 
evident from (10) t^^^^ is the duration of EPSC. It is 
therefore the central variable in our consideration. 

If the number of neurons in the network is large its dyn- 
imics is well described by the mean-field approximation. 
How large the number of neurons should be is discussed 
in the next Section. For the purposes of mean-field treat- 
ment it is sufficient to use the average firing frequency / 
and the average input current / to describe the network 
completely. Thus the network dynamics can be approx- 
imated by one "effective" neuron receiving the average 
input current and firing at the average frequency. As- 
sume that this hypothetical neuron emits spikes at fre- 
quency f{t) (point 1 in Figure 2). Due to the network 
feedback this results in the input current equal to the 
average of Eq. (9), displaced in time by the average du- 
ration of EPSC, i.e. 



/(i + - 



(11) 



This corresponds to the transition between points 1 and 
2 in Figure 2. At last the transition between the input 
current and the firing frequency is accomplished by the 
transduction function T(J) (points 2 and 3). The delay 
due to this transition is of the order of somatic membrane 
time constant (^ 10msec) and is negligible compaed to 
Tgpg^ ~ 100msec. We therefore obtain the equation on 



the firing frequency f{t 



,)=T{l{f{t))) (Wilson 



and Cowan, 1972), or using the Taylor expansion 

w/ = n/(/))-/" 



(12) 



To obtain the steady state solutions we set the time 
derivatives in (12) to zero 



Here is the function inverse to (11). It is shown 

in Figure 2 by the straight solid line. This equation has 
three solutions, two of which are stable. They are marked 
in by letters A and B in the Figure. 

Point B represents the high frequency attractor. Fre- 
quencies obtained in SZ model neurons are not too high. 
They are of the order of a/ro, i.e. in the range 15 — 30 
Hz. This coinsides with the range of frequencies ob- 
served in the delayed activity experiments (Miyashita, 
1988; Miyashita and Chang, 1988; Sakai and Miyashita, 
1991; Fimahashi et al, 1989; Goldman-Rakic et al, 1990; 
Fuster, 1995). The reason for the relatively low firing fre- 
quency rate is as follows. For the leaky integrator model 
the characteristic firing rates in the recurrent network are 
of the order of 1/r, i. e. arc in the range 50 — lOOHz. 
For the SZ neuron r is even smaller (see Figure lb), and 
therefore it seems that the firing rates should be larger 
than for leaky intergator. This however is no true, since 
for the SZ neuron, in contrast to the leaky integrator, 
there is the second time scale. It is the characteristic 
time of variation of the time constant To/a ~ 30 — 50 
msec (see Figure lb). Since the time constant itself is 
very short it becomes irrelevant for the spike generation 
purposes at low firing rates and the second time scale 
determines the characteristic frequency. It is therefore in 
the range 15 — 30Hz. 

Finally we would like to discuss the stability of attac- 
tor B. It can be locally stable, i.e. small noises cannot 
produce the transition from state B to state A. The con- 
dition for this follows from the linerized near equilibrium 
Eq. (12): 



dTdl 
dl df 



< 1 



(14) 



Very rarely, however, a large fluctuation of noise can oc- 
cur, that kicks the system out of the basin of attraction 
of state B. It is therefore never globally stable. This is 
the topic of the next Section. 



III. BEYOND MEAN-FIELD APPROXIMATION 

Computer simulations show that our network can suc- 
cessfully generate delayed activity response. An exam- 
ple is shown in Figure 3a where a short pulse of external 
current (dashed line) produced transition to the high fre- 
quency state. This state is well described by the mean- 
field treatment given in the previous section. This is true, 
however, only for the networks containing a large num- 
ber of neurons N. If the size of the network is smaller 
than some critical number N* the following phenomenon 
is observed (see Figure 3b). The fiuctuations of the cur- 
rent reach the edge of the attraction basin (dotted line) 
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and the network abruptly shuts down, jumping from high 
frequency to the low frequency state. The quantitative 
treatment of these events is the subject of this section. 



FIG. 4. Sudden decay of the dalayed activity in tlie neuron in 
prefrontal cortex during error trial (bottom figure) observed 
by Funahashi et al, 1989. 
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FIG. 3. Total input current averaged over all the neurons in 
the network. A short pulse of the external current brings 
about the transition to the high frequency state, in which 
the total current is larger than the external current due to 
the feedback, (a) In large networks (N=20) the delayed ac- 
tivity can persist virtually forever, until the external inputs 
are changed. The inset shows the traces of neuronal synchro- 
nization: the average current experiences oscillations at the 
average firing frequency, (b) In small network (N=14) the 
high frequency state can decay and the delayed activity dis- 
apear. This results in the average current crossing the edge 
of the attraction basin, trace of which is shown by the dotted 
line. 



Similar decay processes have been observed by Funa- 
hashi et at, 1989 in prefrontal cortex. One of the exam- 
ples of such error trials is shown in Figure 4. 

Neuron 5018 

correct trials 



m ill 




Although the decay is abrupt, the moment at which 
it occurs is not reprodusable from experiment to experi- 
ment. It is of interest therefore to study the distribution 
of the time interval between the initiation of the delayed 
activity and the moment of its decay. Our simulations 
and the arguments given in Appendix B show that the de- 
cay can be considered a Poisson process. The decay times 
have therefore an exponential distribution (see Figure 5). 



0.03 



O0.02 



O.OI 



% 20 40 60 80 100 

t 

FIG. 5. The density of probability of decay at time t obtained 
in the numerical experiment (bars) and the exponential dis- 
tribution with i — 28sec (solid curve). The latter is given by 
Eq. (B8). The numerical results are include 100 trials with 



/ ^ 16Hz, N = 14, 



80msec. 



Since failure to maintain the persistent activity en- 
tails the loss of the memory and incorrect performance 
in the delayed responce task, at least in monkey's pre- 
frontal cortex (Funahashi et ai, 1989), one can use the 
conclusion about Poisson distribution to interpret some 
psychophysical data. In some experiments on rats per- 
forming the binary delayed matching to position tasks 
deterioration of WM is observed as a function of delay 
time (Cole et ai, 1993). The detereoration was char- 
acterized by "forgetting" curve, with matching accuracy 
decreasing from about 100% at zero delay to approxi- 
mately 70% at 30 second delay. The performance of the 
animal approaches the regime of random guessing with 
50% of correct responses in this binary task (Figure 6). 
Our prediction for the shape of the "forgetting" curve 
that follows from the Poisson distribution of delayed ac- 
tivity times is 



Correct = (1 + exp{-t/i))/2 x 100%. 



(15) 



This prediction is used to fit the experimental data in 
Figure 6. 
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FIG. 6. The performance of rats in delayed matching to po- 
sition task (from Cole et ai, 1993). Different markers show 
various degrees of sedation with competitive NMDA antag- 
onist CPP: circles mg/kg; triangles 1 mg/kg; hexagons 3 
mg/kg; pentagons 10 mg/kg. The solid lines represent the 
fits by Eq. (15). The upper and lower lines correspond to the 
average decay times 40 and 15 seconds respectively. 

This Figure also shows the effeet of competitive NMDA 
antagonist CPP. Application of the antagonist reduces 
the average memory retention time i from about 40 sec- 
onds to 15 seconds. The presence of non-compatitive an- 
tagonists impairs performance even at zero delay (Cole et 
ai, 1993; Pontecorvoei ai, 1991). Non-competitive an- 
tagonists have therefore an effect on the components of 
animal behavior different from WM. When the delayed 
component of "forgetting" curve is extracted it can be 
well fitted by an expression containing exponential sim- 
ilar to (15). Such fits also show that the average WM 
storage time t decreases with application of NMDA an- 
tagonist. 

Our calculation in Appendix B show that the average 
memory storage time is given by 



t 



exp KfT,,,^N^AI/lY 



(16) 



Here AI is the distance to the edge of the attraction 
basin from the stable state and I is the average feedback 
current. This result holds if fr^psc ^ 1- Because i is of 
the order of tens of seconds and Tj^pg^ is approximately 
100 msec the exponential in (16) is of the order of 10^-10'^ 
for the realistic cases. 

There are therefore two ways how synaptic receptor 
blockade can affect t. First, the attenuation of the EPSC 
decreases the average firing frequency /. Second, it 
moves the system closer to the edge of the attraction 
basin, reducing A/. Both factors increase the effect of 
noise onto the system, decreasing the average memory 
storage time. This is manifested by Eq. (16). 

Another consequence of the formula is the importance 
of NMDA receptor for the WM storage. It is based on 



the large affinity of the receptor to glutamate, leading 
to long EPSC (t^mda ~ 100 msec), compared for ex- 
ample to AMPA receptor (t^^p^ ~ 15 msec). Eq. (16) 
implies that if AMPA receptor is used in the bistable neu- 
ral net and all other parameters {k, f, N, and AI/I) are 
kept the the same, the memory storage time is equal to 
'''AMPA ~ 15 msec. Thus it is not suprising that NMDA 
receptor is chosen by evolution as a mediator of WM and 
the highest density of the receptor is observed in places 
involved into the WM storage, i.e. in prefrontal cortex 
(Cotman et at, 1987). 




FIG. 7. The network used in text to illustrate the opti- 
mum fluctuation leading to the delayed activity decay. The 
synapses are shown by circles. The synapses releasing neu- 
rotransmitter are shown by full circles. The faihng synapse 
is shown by the open circle. The dendrites and axons are 
represented by thick and thin lines respectively. 



We now would like to illustrate what processes lead 
to the decay time given by (16). Consider a simple net- 
work consisting of three neurons (Figure 7). Assume that 
the ratio A/// for this network is equal to 1/3. This 
implies that the neurons have to lose only 1/3 of their 
recurrent input current due to a fluctuation to stop fir- 
ing. This can be accomplished by various means. Our 
research shows that the most effective fluctuation is as 
follows. Due to probabilistic nature of synaptic transmi- 
tion some of the synapses release glutamate when spike 
arrives onto the presinaptic terminal (full circles in Fig- 
ure 7) some fail to do so (open circle). It is easy to see 
that if the same synapse fails to release neurotransmitter 
in responce to any spike arriving during the time interval 
Tjj,pg(, the reverberations of current terminate. Indeed, 
the failing synapse (open circle) deprives the neuron of 
1/3 of its current. This is just enough to put the input 
current into the neuron below the threshold. The neuron 
therefore stops firing. This deprives the entire network, 
consisting of three neurons, of 1/3 of its feedback current. 
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Therefore the delayed activity in this network terminates. 



In the the most reasonable alternative mechanism of 
decay the average mean-field current would reach the 
edge of the attraction basin i.e. would be reduced by 
1/3. This can be accomplished by shutting down three 
synapses in three different neurons instead of one. Such 
mechanism is therefore less effective than the proposed 
above. Quantitatively the difference is manifested in re- 
ducing the exponent of the factor containg AI/I < 1 
in Eq. (16) from 3 to 2. This bring about an increase 
in the average storage time. The mean-field mechanism 
is therefore less restrictive than the proposed one and is 
disregarded in this paper. 



FIG. 8. The minimum number of neurons N* needed to 
maintain delayed activity with average decay time 20 sec for 
/ ~ 16Hz. The dots show computational results for the case 
of no noise in the external inputs. The triangles correspond 
to the case of 10% white noise added to the external current. 
The solid lines represent the result of analytical calculation 
described below in the text. The dashed line is the vertical 
asymptote of A^* for the case of no external noise. No delayed 
activity can exist to the left of this line, i.e. for the synaptic 
receptor time constant smaller than 37 msec. 



Since an increase of the number of neurons in the net- 
work N dramatically influences the memory storage time 
according to Eq. (16), another characteristic of the relia- 
bility of WM circuit is the minimum number of neurons 
N* necessary to store one bit of information during time 
i. We first study this quantity computationally as fol- 
lows. We run the network simulation many times with 
the same; values of TV and T-^p^,, ■ We then determine the 
average decay time i. Having done this we decrease or in- 
crease N depending on wheater t is larger or smaller than 
a given value (20 sec in all our simulations). This process 
converges to the number of neurons necessary to sustain 
the delayed activity N* for the given value of r^^psc ■ The 
process is then repeated for different values of synaptic 
time-constant. However, the network feedback is always 
renormalized so that the firing frequency stays the same, 
close to the physiologically feasible value / w WHz. This 
corresponds to the attractor state shown in Figure (2). 
The resulting dependence of N* versus r^psc is shown in 
Figure 8 by markers. 
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There are two sets of computational results in Figure 8. 
The higher values of N* are obtained for the network 
with no noise in the external inputs (dots in Figure 8). 
The only source of noise in such a network is therefore the 
unreliability of synaptic connections. It appears for this 
case that no delayed activity can exist for t-^j-,^^^, below 37 
msec. The lower values of A''* are obtained for the case of 
white noise added to the external input (triangles). The 
amplitute of white noise is 10% of the total input current 
and the correlation time is 1 msec. The limiting value of 
synaptic time constant for which the dalayed activity is 
not possible is much smaller for this case (« 5 msec). 



This rcsiilt may seem counter-intuitive. Having added 
the external noise we increased the viability of the 
high frequency state, reducing the effects of the internal 
synaptic noise. This however is not so suprising if one 
takes the neuronal synchrony into account. Synchrony 
of neuronal firing results in oscillations in the average 
input current (see inset in Figure 2a). Such oscillations 
periodically bring the system closer to the edge of the at- 
traction basin, creating additional opprotunities for de- 
cay. Thus the syncronous network is less stable than the 
asynchronous one. External noice attenuates neuronal 
synchrony, smearing the ascillations of the average input 
current. Thus the system with noise in the external in- 
puts should have a larger decay time and smaller critical 
number of neurons N*. This idea is discussed quantita- 
tively below in this Section. This is similar to the sta- 
bilisation of the mean-field solutions in the networks of 
pulse-coupled oscillators (Abbott and Vreeswijk, 1993). 
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FIG. 9. The minimum number of neurons N* needed to main- 
tain delayed activity with average decay time 20 sec for the 
attaractor with average firing frequency 28 Hz. Notations are 
the same as in Figure 8. The cut-off value of synaptic time 
constant is 27 msec. The numerical results with external noise 
in this case are slightly above the theoretical prediction due 
to insufficient suppression of synchrony. 

Figure 9 shows the results of similar calculations for 

the attractor state with a higher average firing frequency 
(/ = 28Hz). This network shows higher reliability and 
smaller values of A''* for both synchronous and asyn- 
cronous (10% noise added) regimes. This is consistent 
with Eq. (16). The results of analytical calculations (sohd 
lines) show satisfactory agreement with the computer 
modeling (markers) . The rest of the Section is dedicated 
to the discussion of different aspects of the analytical cal- 
culations and their results. A more thorough treatment 
of the problem can be foimd in Appendix B. 

To evaluate the minimum number of neurons in the 
closed hand form we solve Eq. (16) for N 



N* w = 



1 



I 

AI 



3/2 



/log 



t 



(17) 



This equation is valid for fr^psc ^1- In the opposite 
case /tj5psc ^ 1 it has to be amended. To obtain the 
correct expression in the latter case the following consid- 
erations should be taken into account. 



A. Fluctuations of the average mean-field current. 

It is obvious that when the mean-field attractor be- 
comes less and less stable in the local sense, i.e. the 
dimensionless feedback coefficient v < 1 [Eq.(14)] ap- 
proaches unity, the global stability should also suffer. In- 
deed, if the system is weakly locally stable the fluctua- 
tions in the average current are large. This should facili- 
tate global instability. The facilitation can be accounted 
for by noticing that the transition from high frequency 



state B to the low frequency one A is most probable when 
the average current is low. Hence to obtain the most re- 
alistic probability of transition and correct values for i 

and TV* one has to decrease the values of average current 
and distance to the edge of the attraction basin by 



I ^ I-6I, 
AI^ AI- SL 



(18) 



where the standard deviation of the average current SI 
is calculated in Appendix B 



51 = 



(19) 



Here / is the average current before the shift. This correc- 
tion decreases the ratio AI/I, decreasing i [see Eq. (16)]. 
This implies the reduced reliability of the network due to 
the average current fluctuations. 



B. Large combinatorial space covered by small groups of 
neurons attempting to cross the attraction basin edge. 

In the simple example with three neurons, in princi- 
ple, each of them can contribute to the process of decay. 
If the network is larger the number of potentially dan- 
gerous groups grows as a binomial coefficient C]^, where 
n = NAI/I < N is the size of the dangerous group. 
The correction to N* can be expressed as follows (Ap- 
pendix B): 



N* 



Here NX is the combinatorial correction 



m 



I y (j){AI/I) + {AI/I)\nA 

AlJ k/Tepsc 



(20) 



(21) 



Here 



A = 



(pix) =a;ln[l/a;]-|-(l-a;)ln[l/(l-a;)] 



(22) 



Since the combinatorial contribution is proportional 

to 1 / /Tj^psc it is negligible compared to N* oc 1/ \/Jt^^psc 
at large values of r^p^c ■ Therefore N* « as claimed 
by Eq. (17) in this limit. On the other hand if Tj^p^c 
is small the main contribution to the critical number of 
neurons N* comes from 

The right hand sides of Eqs. (17) and 21 contains de- 
pendence on iV* through the shift in distance to the at- 
traction edge 61 and the coefficient A. This dependence 
is weak however since the former represents a very small 
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correction and the latter depends on N* only logarith- 
mically. Nevertheless to generate a numerically precise 
prediction we iterate Eq. (17), (20), and (17) until a con- 
sistent value of A^* is reached. The results are shown 
by lower solid lines in Figures 8 and 9. They are in a 
good agreement with numerical simulations in which the 
synchrony of firing was suppressed by external noise. 



C. Neuronal synchrony. 

The synchronizaton of neuronal firing can be critical 
for the stability of the high frequency attractor. Con- 
sider the following simple example (Wang, 1999). Con- 
sider the network consisting on only one neuron. Assume 
that the external input current to the neuron exceeds 
the firing threshold /* at certain moment and the neu- 
ron starts emiting spikes. Assume that the external cur- 
rent is then decreased to some value below the threshold. 
The only possibility for the neuron to keep firing is to 
receive enough feedback current from itself, so that the 
total input current is above threshfold. Suppose then for 
illustration purposes that the synapse that the neuron 
forms on itself (autapsc) is infinitely reliable, i.e. every 
spike arriving on the presynaptic terminal brings about 
the release of neurotransmitter. It is easy to see that if 
the duration of EPSC is much shorter than the interspike 
interval the persistent activity is impossible. Indeed, if 
EPSC is short, at the moment, when the new spike has to 
be generated there is almost no residual EPSC. The input 
current at that moment is almost entirely due to exter- 
nal sources, i.e. is below the threshold. The new spike 
generation is therefore impossible. We conclude that the 
persistent activity is impossible if EPSC is short, i. e. for 
/"^Epsc ^ 1- ^ote, that this conclusion is made assuming 
no noise in the system. 

The natural question is why this conclusion is relevant 
to the network consisting of many neurons? Our com- 
puter modeling shows that in the large network the neu- 
ronal firing pattern is highly sychronized on the scales of 
the order of T = 1//. In essence all neurons fire simul- 
taneously and periodically with the period T. Therefore 
they behave as one neuron. Hence the delayed activity 



SI, 



21 



syn 



-1// 



^■^^'^c (/Tepsc + 1) 



(23) 



and 



1 - e-^//^E 



AI^AI- SL. 



(24) 



Here / is the average current given by (18). This cor- 
rection, which is the amplitude of the oscillations of the 
average current due to synchrony, is in good agreement 
with computer modeling (see insert in in Figure 3a) . The 
synchrony does not change the average current in the 
network significantly. Therefore the latter should not be 
shifted as in (18). 

These corrections imply that if the original value of A/ 
is equal to the sum 51 + 51 syn [see Eq. (19)], the effective 
distance to the edge of attraction basin vanishes. The 
delayed activity cannot be sustained under such a con- 
dition. This occurs at small values of T^-p^c ^-^d deter- 
mines the positions of vertical asymptotes (dashed lines) 
in Figures 8 and 9. This gives a quantitative meaning 
to the argument of impossibility of stable delayed activ- 
ity in synchronous network at small values of synaptic 
time constant given above (sec also Wang, 1999). When 
the synchrony is diminished l)y external noise, the cut 
off value of t-^^^^ is determined only by A/ = 51 and is 
therefore much smaller. It is about 5 msec in our com- 
puter siniilations. 

Synchrony also affects the values of the critical num- 
ber of neurons for large and small fr^psc i^i ^'^d 
respectively) 



(25) 



NLyn = I ^ 




N. 



2syn 



I 

AI 



<{AI/I) + {AI/I)lnA 1 



=.2//-rE 



1 



(26) 



These cqiiations are derived in Appendix B. To ob- 
tain the value of critical number of neurons N* Eq. (20) 
should be used. Let us compare the latter equations to 
(17) and (21). In the hmit / » 1 the expressions for 



in such network is impossible if fr^psc < 1 even in the and N^^y^ converge to the same asymptote 



absence of synatic noise. Thus the synchrony facilitates 
the decay of the delayed activity brought about by the 
noise. This is consistent with the results of computer 
simulations presented if Figures 8 and 9. 

As it was mentioned above synchrony facilitates the in- 
stability by producing the oscillations in the average cur- 
rent and therefore by bringing the edge of the attraction 
basin closer. It therefore effectively decreases AI. The 
magnitude of this decrease is estimated in Appendix B 
to be 



whereas both and A^lsj/n go to zero. 

Since again, as in asynchronous case, both A'^isj,„ and 
^2syn depend on the quantity that we are looking for 
N* (however, again, very weakly), an iterative proce- 
dure should be used to determine the consistent value of 
N* . Having applied this iterative procedure we obtain 
the ipper solid lines in Figures 8 and 9. We therefore 
obtain an excellent agreement with the results of the nu- 
merical study. In addition we calculate the cut-off r^pgc , 
below which the delayed activity is not possible for the 
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synchronous case. For the attractor with / « 16 Hz the 
cut-off value is 37 msec, while for the higher frequency 
attractor (/ w 28 Hz) the value is 21 msec. These val- 
ues are shown in Figures 8 and 9 by dashed lines. Wc 
therefore conclude that the delayed activity mediated by 
AMPA receptor is impossible in the synchronous case. 



IV. DISCUSSION 

In this work we derive the relationship between the dy- 
namic properties of the synaptic receptor channels and 
the stability of the delayed activity. We conclude that 
the decay of the latter is a Poisson process with the av- 
erage decay time exponentially depending on the time 
constant of EPSC. Our quantitative conclusion applied 
to AMPA receptor, having a short EPSC, implies that it 
is incapable of sustaining the persistent activity in case of 
synchronization of firing in the network. For the case of 
asynchronous network one needs a large number of neu- 
rons > 30 to store one bit of information with AMPA 
receptor. On the other hand NMDA receptor seems to 
stay away from these problems, providing reliable quan- 
tum of information storage with about 15 neurons for 
both synchronized and asynchronous case. We therefore 
suggest an explanation to the obvious from experiments 
high significance of the NMDA channel for WM. 

One can conclude from our study that if the time con- 
stant of NMDA channel EPSC is further increased, the 
WM can be stored for much longer time. Assume that 
T^psc is increased by a factor of 2, for instance, by ge- 
netic enhancement (Tang et al, 1999). If the network 
connectivity, firing frequency, and average currents stay 
the same as in the wild type, the exponential in Eq. (16) 
is increased by a factor of 10'^. This implies that the 
working memory can be stored by such an animal for 
days, instead of minutes. Alternatively the the number 
of neurcms responsible for the storage of quantum of in- 
formation can be decreased by a factor 0.7 keeping the 
storage time the same. This implies the higher storage 
capacity of the brain of mutant animals. 

We predict that with normal NMDA receptor the num- 
ber of neurons able to store one bit of information for 
40 sec is about 15. Should our theory be applicable to 
rats performing delayed matching to position task (Cole 
et al., 1993) the conclusion would be that the recurrent 
circuit responsible for this task contains < 15 neurons. 
Of course this would imply that other sources of loss of 
memory, such as distraction, are not present. 

The use of very simple model network allowed us to 
look into the nature of the global instability of delayed 
activity. The principal result of this paper is that the 
unreliability of synaptic conductance provides the most 
effective channel for the delayed activity decay. We pro- 
pose the optimum fluctuation of the synaptic noises lead- 



ing to the loss of WM. Decay rates due to such a fluctu- 
ation agree well with the results of the numerical study 
(Section HI). Thus any theory or computer simulation 

that docs not take the unreliability of synapses into ac- 
count does not reproduce the phenomenon exactly. 

We also studied the decay process in the presence of 
noise in the afferent inputs. The study suggests that 
the effect of noise on the WM storage reliability is not 
monotonic. Addition of small white noise (< 10% of 
the total external current) increases the reliability, by 
destroying synchronization. It is therefore beneficial for 
the WM storage. Further increase of noise (> 12%) de- 
stroys WM, producing transitions between the low and 
high frequency states. We conclude therefore that there 
is an optimum amount of the afferent noise, which on one 
hand smoothes the synchrony out and on the other hand 
does not produce the decay of delayed activity itself. Fur- 
ther work is needed to study the nature of influence of 
the external noise in the case of unreliable synapses. 

If the afferent noise is not too large the neurons fire in 
synchrony. The natural consequences of synchrony are 
the decrease of the coefficient of variation of the inter- 
spike interval for single neuron and the increase of the 
crosscorrelations between neurons. The latter prediction 
is consistent with findings of some multielectrode studies 
in monkey prefrontal cortex (see Dudkin et al., 1997a). 
On the other hand sinchrony may also be relevant to the 
phenomenon of temporal binding in the striate cortex 
(Engel et al., 1999; Roskies, 1999). We argue therefore 
that temporal binding with the precision of dosens of mil- 
lisconds can be accomplished by formation of recurrent 
neural networks. 

We also suggest the solution to the high firing fre- 
quency problem by using a more precise model of the 
spike generation mechanism, i.e. the leaky integrator 
model with varying in time resting potential and inte- 
gration time. The minimum firing frequency for the re- 
current network based on such model is determined by 
the rate of variation of the potential and time-constant 
and is within the range of physiologically observed val- 
ues. Further experimental work is needed to see if the 
model is applicable to other types of neurons, such as 
inhibitory cells. 

In conclusion we have studied the stability of delayed 
activity in the recurrent neural network subjected to the 
influence of noise. We conclude that the global stabil- 
ity of the persistent activity is affected by properties of 
synaptic receptor channel. NMDA channel, having a long 
EPSC duration time, is a reliable mediator of the delayed 
responce. On the other hand AMPA receptor is much less 
reliable, and for the case of synchronized firing in prin- 
ciple cannot be used to sustain responce. Effect of the 
NMDA channel blockade on the WM task performance 
is discussed. 
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APPENDIX A: SINGLE-NEURON TRANSDUCTION 
FUNCTION 

In this Appendix we calculate the single-neuron trans- 
duction function. The first step is to find the membrane 
voltage as a function of time. From Eq. (1) using the 
variation of integration constant we obtain 

V{t) = Vresete-^^'^ 

+ f dt'e^(*')-^W [I{t') + E{t')/T{t')] . 



(Al) 



Here 



Sit)= fdt'/r{t' 

J to 



(A2) 



and we introduced the refractory period both for gener- 
ality and to resolve the peculiarity at t = 0. For constant 
current and functions given by (2) and (3) the expression 
for voltage can be further simplified: 



V{t) = Vresete 



-S{t) 



En 



1 



+ 



-S{t) 



-S{t) 



(A3) 



where 



To J a (gato/ro _ 1^/" 

S{t) = -ln(^. 

and Ln{x) is defined for integer n by 

Lq{x) = \n{x), 



Ln{x) = -{x - 1)" - Ln-i{x), 
n 



(A4) 



(A5) 



and is obtained for fractional n by anal}ftical continua- 
tion. For example 



Li{x) = X —1 — \n{x), 

L2{x) = {x- lf/2 -x + l- \n{x), 

L3{x) = {x- if/?, -{x- lf/2 + X-1- \n{x), 



(A6) 



Solving the equation V{f^ = 9 produces the interspike 
interval t and frequency / = 1/t. The solution cannot be 
done in the closed form. Some asymptotes can be calcu- 
lated however. The calculation depends on the value of 
parameter ^ = at/ro. 

i)C = at/To « 1. 

In this limit 



-S(t) 



1) 



l/r 



^+e/2 



(A7) 



is very small and can be neglected everywhere, except for 
when multiplied by large factor I/i/c,. The latter product 



ott/ro\ p-S{t) 



(gato/ro _ \^ 



1/a 



— ({ + ^1- 

l-haV^ 2/ l-|-2a 



(A8) 



The equation on the interspike interval is 



e = Eo + {toI - AE) 



l+a 2 (l-ha)(l-|-2a) 



(A9) 



Solving this quadratic equation with respect to ^ we ob- 
tain the asymptote given by Eq. (4). 
ii) ^ > 1. 

In this case the solution can be found directly from 
Eq. (1) by assuming V = 0. Solving the resulting alge- 
braic equation for t we obtain Eq. (7) above. 



APPENDIX B: DECAY OF THE HIGH FREQUENCY 
ATTRACTOR 

1. Asynchronous case: derivation of A'^i and N2 

The average and standard deviation of the input cur- 
rent of each neuron, given by Eqs. (9) and (10) are 



-Jo 



and 



511 = (In - If = NKfT^,,^J^/2. 



(Bl) 



(B2) 



The distribution of /„ is therefore, according to the cen- 
tral limit theorem 



P{ln) = 



exp 



{In-]_f 

2511 



(B3) 



The probability that the input current is below thresh- 
old /*, i.e. the neuron does not fire, is given by the error 
function derived from distribution (B3) 
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//* 
dInP{In) « Ae-«-f^EPSC^A-fV/" 
-oo 



(B4) 



where A = I / AI ^/Ath^Jt^^^ , and AJ = / - /*. In 
derivation of (B4) we used the asymptotic expression for 
the error function 



dx- 



crv^ \y\V2n 



(B5) 



when y <C — cr. 

The reverberations of current will be impossible if 
n = NAI/I neurons are below threshold. When this 
occurs the feedback current to each neuron is reduced 
with respect to the average current by AJ, i.e. is be- 
low threshold, and further delayed activity is impossible. 
The probability of this event is given by the binomial 
distribution: 



Here the binomial coefficient C 



(B6) 

- N\/{N - n)\n\ ac- 
counts for the large number of groups of neurons that 
can contribute to the decay. 

Since the input currents stay approximately constant 
during time interval r^pgc, we brake the time axis into 

Epsc- Denote by p 



windows with the duration At ^ Tj,p 
the average probability of decay of the high frequency 
activity during such a little window. Assume that k win- 
dows have been passed since the delayed activity com- 
menced. The probability that the decay occurs during 
the k-th time window, i.e. exactly between t = kAt and 
t={k + l)At, is 



p(t)Ai=(l-p)V 



(B7) 



Here (1 — p)'' is the probability that the decay did not 
happen during cither of k early time intervals. After sim- 
ple manipulations with this expression we obtain for the 
density of probability of decay as a function of time 



Pit) 



/pAt. 



(B8) 



(BIO) 



In the limit fr-^psc -'- minimum size of the 
network necessary to maintain the delayed activity is 
small. Wc can assume therefore N to be small in this 
limit. The same assumption can be made for n < iV. 
Thus for an effective network (using the neurons spar- 
ingly) wc can assume the combinatorial term in Eq. (B6) 
to be close to unity. Since in the expression for po ~ 
C^A^ exp (^—nnfT^p^^NAP/P) it is also compensated 
by the small prefactor of the exponential A" < 1 [see 
Eq. (B4)], we can assume CJ^A" ~ 1 for the effective 
network. Therefore in the limit fr^psc ^ 1 the main de- 
pendence of the parameters of the model is concentrated 
in the exponential factor. This set of assumptions in 
combination with Eq. (BIO) leads to the expression (16) 
in the main text. If more precision is needed Eq. (BIO) 
can be used directly. 

To find the critical number of neurons N* we calculate 
logarithm of both sides of Eq. (BIO). We obtain 



In (Vtepsc) « - InC^, - nlnpo 



(Bll) 



Using asymptotic expression for the logarithm of the bi- 
nomial coefficient, which can be derived from the Stir- 
ling's formula. 



lnC]^«7V</.(n/Ar);7V,n» 1; 

(pix) =xln [1/x] + (1 - a;) In [1/(1 - x)], 

we derive the quadratic equation for TV* 



(B12) 



(B13) 



-N* 



Ai\ Ai ; 

— H A 

I y / 



- In- 



0. 



Solving this equation we obtain the set of equations (17), 
(20), and (21) in the main text. 



This is a Poisson distribution and decay is a Poisson 
process. The reason for this is that the system retains 
the values of input currents during the time interval 
At 

^ ^Bpsc msec. Therefore all processes sepa- 

rated by longer times are independent. Since the decay 
time is of the order of 10-100 seconds, the attempts of 
system to decay at various times can be considered inde- 
pendent. We finally notice that since the values of current 
are preserved on the scales of r^pg^ we can conclude that 



P^Po 



(B9) 



given by Eq. (B6). The average decay time can then be 
estimated using (B8) 



2. Synchronous firing case 

In this subsection we assume that all the neurons in 
the network fire simultaneously. The important quanti- 
ties which will be studied are the time dependence of the 
averaged over network current I{t) and the fluctuations 
of the input current into single neuron 6j^. The former 
is responsible for the shift in the distance to the edge of 
the attraction basin (Eq. (24)), the latter determines the 
average decay time, as follows from the previous subsec- 
tion. 

Assume that the neuron fired at t = 0. The average 
number of EPSC's arriving to the postsynaptic terminal 
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is kN due to finitncss probability of the synaptic vesicle 
release k and all-to-all topology of the connections. The 
average current at times 0<t<T=l//is contributed 
by the spikes at t = and by all previous spikes at times 
Tk, fc = 1,2,...: 



I{t) = /oe-*/^EPsc + Joe-(*+^)/^EPsc + . . 
= 7oe~*/'^EPsc /(I — e~^/ ■'''^EPsc ), 



(B14) 



where we introduced the notation Iq = nNjo. The aver- 
age over time value of this averaged over neurons current 
is < I >= ^o./Tepscj where by angular brackets we de- 
note the time average: < A >= A{t)dt/T. The aver- 
age current / therefore experiences oscillations between 
Imax = 1(0) and Imin = I (T) ■ The minimum value of 
/ is below the average current < I >. This minimum 
value, according to the logic presented in the main text, 
determines the shift of the distance to the edge of the at- 
traction basin. This shift is therefore < I > —Imin- Our 
computer modeling however shows that the actual ampli- 
tude of the current oscillations is consistently about 60% 
of the value predicted by this argument. This was tested 
at various values of parameters. The explanation of this 
60% factor is as follows. In case if all the neurons fire 
simultaneously the shape of the dependence of the aver- 
age current versus time is saw-like. However the spikes 
do not fire absolutely simultaneously. The uncertainty in 
the spiking time is of the order of T. This uncertainty, 
which is intrinsic to the recurrent synaptic noises, and 
therefore is difficult to calculate exactly, smears out the 
saw-like dependence of the average current of time (see 
inset in Figure 3a) . Approximately this smearing can be 
accounted for by dumping the higher harmonics of the 
saw-like dependence. When only principal harmonic re- 
mains, the amplitude of the saw-like curve is reduced by 
a factor 2 /pi ^ 0.6. This is consistent with the numerical 
result. We therefore conclude that the shift of AI is 



SI 



syn 



0.6 [< J > -/(T)] , 



(B15) 



what leads to Eq. (23) in the text. 

We now turn to the calculation of the standard devi- 
ation of the input current into one neuron. Similar to 
(B14), using the central limit theorem we obtain 



■{2t+2Tk)/T„ 



(B16) 



fe=0 



This quantity is most important at f w T when the av- 
erage current reaches its minimum and the neuron stops 
firing with maximum probability. Performing the sum- 
mation we therefore obtain 



('«/w)'^e2//-EPsc -1' 



(B17) 



Substituting this value into Eq. (B4) in the previous sub- 
section and repeating the subsequent derivation we ob- 
tain Eqs. (25) and (26) in the main text. 



3. Fluctuations of the average current 

In this subsection we calculate the fluctuations of the 
average netwotk current. We consider asynchronous case 
for simplicity. The conclusions are perfectly good for 
synchronous case, for the reasons that will become clear 
later in this subsection, and agree well with computer 
similations. 

The average current satisfies linarized equation similar 
to linearized version of Eq. (12) 



T,p3^A/(t) = (j.-l)A/(i)+e(i)- 



(B18) 



Here A7(t) is the deviation of the averaged over network 
current from the equilibrium value and ^(t) is the noise. 
The unitless network feedback coefficient ;y < 1 is de- 
fined by (14). As evident from this equation A/(t) has 
a slow time constant Tj^psc/ll ^ ^) [since 1/(1 — i^) > 5 
in our simulations]. On the other hand the noise ^(t) is 
determined by synapses and has a correlation time that 
is relatively small (~ t^^sc ) ■ 

The correlation function of noise in the average current 
can be found from Eq. (9) 

m ^ mm) = ^-§^M~\t\/r^.sc)- (bw) 

Here angular brackets imply averaging over time and the 
value of S(/: — 0) follows from Eq. (B2) and the cen- 
tral limit theorem (dispersion of the average is equal to 
the dispersion of cuvh of the homogcnious constituents 
/„ divided by the number of elements N). We conclude 
therefore that 



S(t = 0) 



^/'''epsc-^^ 



(B20) 



The correlation function of A7 can then be easily found 
from Eq. (B18) using the Fourier transform. Define 
C{t) = {AI{t)AI{0)). Then 

C{u,) = (|A7»|^) = 3 (B21) 

\ / (l-r/)2-h(wr^P3c) 



Since 



S(a;) 



2»T-Epsc-(^ = 0) 
1 + {UJT^PSC) 



2 ' 



(B22) 



the expression for C(t) is readily obtained by inverting 
the Fourier transform (B21). In the limit 1 — i/ <C 1, 
which holds in our simulations the answer is 
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C{t) = exp [-(1 - . (B23) 

The value of C taken at f = determines the standard 
deviation of the average current (19). 

The fluctuations described by the correlation function 
(B23) have a large correlation time compared to the firing 
frequency. We conclude therefore that synchrony should 
not affect the long range component of the correlation 
function. 
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